Style Transfer in Text: Exploration and Evaluation

Style transfer is an important problem in natural language processing (NLP). However, the progress in language style transfer is lagged behind other domains, such as computer vision, mainly because of the lack of parallel data and principle evaluation metrics. In this paper, we propose to learn style transfer with non-parallel data. We explore two models to achieve this goal, and the key idea behind the proposed models is to learn separate content representations and style representations using adversarial networks. We also propose novel evaluation metrics which measure two aspects of style transfer: transfer strength and content preservation. We access our models and the evaluation metrics on two tasks: paper-news title transfer, and positive-negative review transfer. Results show that the proposed content preservation metric is highly correlate to human judgments, and the proposed models are able to generate sentences with higher style transfer strength and similar content preservation score comparing to auto-encoder.Comment: To appear in AAAI-1

Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Natural language understanding is a challenging problem that covers a wide range of tasks. While previous methods generally train each task separately, we consider combining the cross-task features to enhance the task performance. In this paper, we incorporate the logic information with the help of the Natural Language Inference (NLI) task to the Story Cloze Test (SCT). Previous work on SCT considered various semantic information, such as sentiment and topic, but lack the logic information between sentences which is an essential element of stories. Thus we propose to extract the logic information during the course of the story to improve the understanding of the whole story. The logic information is modeled with the help of the NLI task. Experimental results prove the strength of the logic information.Comment: Student Abstract in AAAI-201

Climate warming accelerates temporal scaling of grassland soil microbial biodiversity.

Determining the temporal scaling of biodiversity, typically described as species-time relationships (STRs), in the face of global climate change is a central issue in ecology because it is fundamental to biodiversity preservation and ecosystem management. However, whether and how climate change affects microbial STRs remains unclear, mainly due to the scarcity of long-term experimental data. Here, we examine the STRs and phylogenetic-time relationships (PTRs) of soil bacteria and fungi in a long-term multifactorial global change experiment with warming (+3 °C), half precipitation (-50%), double precipitation (+100%) and clipping (annual plant biomass removal). Soil bacteria and fungi all exhibited strong STRs and PTRs across the 12 experimental conditions. Strikingly, warming accelerated the bacterial and fungal STR and PTR exponents (that is, the w values), yielding significantly (P < 0.001) higher temporal scaling rates. While the STRs and PTRs were significantly shifted by altered precipitation, clipping and their combinations, warming played the predominant role. In addition, comparison with the previous literature revealed that soil bacteria and fungi had considerably higher overall temporal scaling rates (w = 0.39-0.64) than those of plants and animals (w = 0.21-0.38). Our results on warming-enhanced temporal scaling of microbial biodiversity suggest that the strategies of soil biodiversity preservation and ecosystem management may need to be adjusted in a warmer world

POTs: Protective Optimization Technologies

Algorithmic fairness aims to address the economic, moral, social, and political impact that digital systems have on populations through solutions that can be applied by service providers. Fairness frameworks do so, in part, by mapping these problems to a narrow definition and assuming the service providers can be trusted to deploy countermeasures. Not surprisingly, these decisions limit fairness frameworks' ability to capture a variety of harms caused by systems. We characterize fairness limitations using concepts from requirements engineering and from social sciences. We show that the focus on algorithms' inputs and outputs misses harms that arise from systems interacting with the world; that the focus on bias and discrimination omits broader harms on populations and their environments; and that relying on service providers excludes scenarios where they are not cooperative or intentionally adversarial. We propose Protective Optimization Technologies (POTs). POTs provide means for affected parties to address the negative impacts of systems in the environment, expanding avenues for political contestation. POTs intervene from outside the system, do not require service providers to cooperate, and can serve to correct, shift, or expose harms that systems impose on populations and their environments. We illustrate the potential and limitations of POTs in two case studies: countering road congestion caused by traffic-beating applications, and recalibrating credit scoring for loan applicants.Comment: Appears in Conference on Fairness, Accountability, and Transparency (FAT* 2020). Bogdan Kulynych and Rebekah Overdorf contributed equally to this work. Version v1/v2 by Seda G\"urses, Rebekah Overdorf, and Ero Balsa was presented at HotPETS 2018 and at PiMLAI 201